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Abstract 

We prove a Noether-type symmetry theorem for invariant optimal con¬ 
trol problems with unrestricted controls. The result establishes weak con¬ 
servation laws along all the minimizers of the problems, including those 
minimizers which do not satisfy the Pontryagin Maximum Principle. 
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1 Introduction 

Emmy Noether’s first theorem El is one of the most beautiful and fundamental 
results of the calculus of variations. The result comprises a universal principle, 
connecting the existence of a family of transformations under which the func¬ 
tional to be minimized is invariant (the existence of variational symmetries) with 
the existence of conservation laws (first integrals of the Euler-Lagrange differ¬ 
ential equations). Conservation laws can then be used to simplify the problem 
of finding the minimizers. They have played an important role, both in mathe¬ 
matics and physics, since the birth of the calculus of variations in the eighteen 
century, having been extensively used by giants like the Bernoulli brothers, New¬ 
ton, Leibniz, Euler, Lagrange, and Legendre. Conservation laws, obtained from 
Noether’s theorem, have a profound effect on a vast number of disciplines, rang¬ 
ing from classical mechanics, where they find important interpretations such as 
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conservation of energy, conservation of momentum, or conservation of angular 
momentum, to engineering, economics, control theory and their applications |S]. 

The first extension of Noether’s theorem to the more general context of opti¬ 
mal control was published in 1973 [Sj- Since then, many Noether-like theorems 
have been obtained in the context of optimal control - see E3 and references 
therein. We recall that all such versions of Noether’s theorem assume the Pon- 
tryagin maximum principle m to be satisfied, and use its conditions, including 
the adjoint system, in their proofs. 

Optimal control with unbounded controls is an area of strong current ac¬ 
tivity, because of numerous applications involving modern technology such as 
“smart materials” 0. When there are no restrictions on the values of the control 
variables, as in the calculus of variations, it is well known that optimal control 
problems may present solutions for which the Pontryagin Maximum Principle 
fails to be satisfied (see e.g. m § 11.1]). This is due to the fact that the 
hypotheses of the existence theory need to be complemented with additional 
regularity conditions in order to proceed with the arguments which lead to the 
maximum principle unboundedness of the controls “propagates” through 
the dynamical control system, often causing a lack of regularity for the solutions. 

In spite of the gap between the hypotheses of necessary optimality conditions 
and existence theorems, J. Ball proved PP that, for time-invariant problems, the 
conservation of the Hamiltonian (conservation of energy) is still valid for min- 
imizers which might not satisfy the Euler-Lagrange necessary condition. More 
recently, in 2002, G. Francfort and J. Sivaloganathan proposed a generalization 
of Ball’s result, giving some applications to hyper-elasticity (ZJ. 

In this note we extend the previous results |JJ from the calculus of variations 
framework to the optimal control setting. We obtain weak conservation laws for 
minimizers which do not necessarily satisfy the Pontryagin maximum principle. 


2 Bad Behavior in Optimal Control 

The optimal control problem consists to minimize a cost functional 

I [*(■). «(')] = [ L (*. x(t), u(t)) dt 

J a 

subject to a control system described by ordinary differential equations 

x(t) = ip(t,x(t),u(t)) (1) 

together with certain appropriate endpoint conditions. The Lagrangian L : 
[a, b] x 1” x R m —y R and the velocity vector ip : [a, b] x R” x R m —► R" are 
given, and assumed to be smooth: L(-, •, •), £ C 1 . We are interested 

in the case where there are no restrictions on the control set: u{t) £ R m . We 
denote the problem by (P). In the particular case ip(t,x,u) = it, one obtains 
the fundamental problem of the calculus of variations, which covers all clas¬ 
sical mechanics. The choice of the classes X and U, respectively of the state 
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x : [a, 6] — > R™ and control variables u : [a, b] —> R m , play an important role 
in our discussion. In connection with the Pontryagin maximum principle, the 
optimal controls are typically assumed to be essentially bounded, U = JT3J; 
while to guarantee existence, compactness arguments require a bigger class of 
measurable control functions, U = L\ [5j. Given an optimal control problem 
with unrestricted controls, it may happen that the Pontryagin maximum prin¬ 
ciple is valid, while existence of minimizers is not guaranteed; or it may happen 
that the minimizers predicted by the existence theory fail to be Pontryagin 
extremals. Conservation laws are obtained from Noether’s theorem, assuming 
that the minimizers are Pontryagin extremals. In this work our objective is to 
prove weak conservation laws valid for bad-behaved problems with minimizers 
which are not Pontryagin extremals. We begin to explain why bad-behavior can 
occur. 

The Pontryagin maximum principle is a necessary optimality condition which 
can be obtained from a general Lagrange multiplier theorem in spaces of infinite 
dimension (cf. e.g. 11011121 1. Introducing the Hamiltonian function 

H(t, x, u, ip) = —L(t, x,u) + ip ■ ip(t, x , u ), ( 2 ) 


where ipi , i = 1 ,n, are the “Lagrange multipliers” or the “generalized mo¬ 
menta” , the multiplier theorem asserts that the optimal control problem is 
equivalent to the maximization of the augmented functional 

J [z(-)> u(-), ip(-)} = f (H(t,x(t),u(t),ip(t))-ip(t)-x(t))dt. (3) 

J a 

Let us assume, for simplicity, X = C 1 ([a, 6 ]; R”), U = C ([a, 6 ]; R m ). Let 
u(-), solve the problem, and consider arbitrary C 1 -functions hi , /13 : 

[a, b] —> R ra , hi(-) vanishing at a and b (hi{-) £ Cq ([a, &])), and arbitrary con¬ 
tinuous h -2 : [a,b] —> R m . Let e be a scalar. By definition of maximizer, we 
have 


{x + ehi)(-), (u + eh 2 ){-), (ip + eh 3 )(-) 


< J 


x(-),u(-),ip(-) 


and one has the following necessary condition: 



(x + ehi)(-), (u + eh 2 )(-), (ip + eh 3 )(-) 


= 0 . 

e=0 


Differentiating gives 


(4) 


r dH i sx 
0 = J a 

+ -Q- (t,x(t),u(t) 


dH / ~ \ 

hi(t) + — \ t,x(t),u(t),ip(t)) ■ h 2 (t ) 


h 3 (t) - h 3 (t) ■ x(t) - ip(t) ■ hi(t) 


dt . (5) 
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Integrating the ip[t) ■ h\{t) term by parts, and having in mind that h\{a) = 
hi(b) = 0, one derives 



dH 

dx 


+ ip{t)j ■ h\[t) +— (t,x(t),u(t), 
(t,x(t),u(t),ip(tf) -x(t) J -h 3 (t) 


dH 

dip 


dt = 0. 


h 2 (t) 

( 6 ) 


Note that © was obtained for any variation /ii(-), h 2 (-), and h 3 (-). Choosing 
hi(t) = h 2 (t) = 0, and h 3 (-) arbitrary, one obtains the control system 0 : 


x{t) = 


dH 

dip 


(t,x{t),u(t),ip{tf) , 


t £ [a, b]. 


(7) 


With ft-i(-) arbitrary, and h 2 (t) = h 3 (t) = 0, we obtain the adjoint system : 

~ dH / ~ \ 

i>(t) = - (t.,x(t),u(t),ip(t)) , t £ [a, b] . (8) 

Finally, with h 2 (-) arbitrary, and hi(t) = h 3 (t) = 0, the maximality condition is 
obtained: 

dH / ~ \ 

— (t,x{t),u{t),ip{t)J = 0, t£[a,b}. (9) 

A necessary optimality condition for (x(-),u(-)) to be a minimizer of problem 
(P) is given by the Pontryagin maximum principle : there exists ip(-) such that 
the 3-tuple ^x(-), u(-), ip(-)^j satisfy all the conditions 0, ©, and ©. We recall 
that conditions 0 , ®, and 0 imply the equality 

-^H (t,x(t),u(t),ip(t)') = ^ (t,x(t),u(t),ip(t)j . ( 10 ) 

For piecewise smooth state trajectories, X = PC 1 ([a, 6 ]; R ra ), and piecewise 
continuous controls, U = PC ([a, 6 ];R m ), similar arguments than those used to 
derive conditions 0 , and 0 continue to be justifiable. In fact, as already 
mentioned, the arguments can be carried out for essentially bounded controls, 
U = L 00 ([a,&];R m ), and Lipschitzian state variables, X = Wi j00 ([a, b]; R”). 
But if one took U = L\ ([a, 6 ];R m ), and X = Wfyi ([a, 6 ];R"), as required by 
the existence theory, integration by parts of ip(t) ■ h\(t) in 0 can no longer 
be justified, and one can not conclude with the adjoint system 0 and equality 
m- This is more than a technical difficulty, and explains the possibility of bad- 
behavior illustrated by the Ball-Mizel example )2]- In the Ball-Mizel problem 
one has n = m = 1, L(t , x, u) = ( x 3 — t 2 ) 2 u 14 + eu 2 , and ip(t, x , u ) = u: 


/o L 


(x 3 (t) — t 2 )" u(t) 14 + eu[t) 2 dt —>min, 

x(t) = u (t ) , 
x (0) = 0 , x (1) = k . 
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For some values of the constants e and k there exists the unique optimal con¬ 
trol u(t) = |3], which belongs to Li but not to L^. The Pontryagin 

maximum principle is not satisfied since the adjoint system © 

i>{t) = (t,x{t),u(t ),^ t ~ A/3 

is not integrable. In this paper we obtain a new version of Noether’s theo¬ 
rem, without using the adjoint system © and the property dig. This makes 
Noether’s principle valid both for well- and bad-behaved optimal control prob¬ 
lems. 


3 Conservation Laws in Optimal Control 

In 1918 Emmy Noether established the key result to find conservation laws in 
the calculus of variations mm- We sketch here the standard argument used to 
derive Noether’s theorem and conservation laws in the optimal control setting 
(cf. e.g. 0I2|). 

Let us consider a one-parameter group of C-transformations of the form 
h s (t,x,u,ip) = (h t {t,x,u,ip,s),h x (t,x,u,ip,s),h u (t,x,u,tp,s),h^(t,x,u,tp,s)) , 

CO 

where s denote the independent parameter of the transformations. We require 
that to the parameter value s = 0 there corresponds the identity transformation: 


h°(t, x, u, ip) 


( h t (t , x, u, ip, 0), h x (t, x, u, ip, 0), h u (t, x, u, ip, 0), h^(t, x, u, ip, 0)) 
(t, X, u, ip). 

( 12 ) 


Associated to the group of transformations O we consider the infinitesimal 
generators 


T(t,x,u,il>) = —ht(t,x,u,il),s) 
as 


U(t, x, u, -0) = —huit.x.u^.s) 
as 


s—0 


S= 0 


, = —h x (t, x, u, , 0, s) 

as 


, '&(t,x,u,il>) = —hAt.x.u^.s) 

as 


s =o 

(13) 


8 =0 


Definition 1. The optimal control problem (P) is said to be invariant under a 
one-parameter group of C 1 -transformations CD if, and only if, 


d_ 

ds 


H (h s (t,x(t),u(t),ip(t))) 


-fhj, (t,x(t),u(t), ip(t), s) 


dh x (t ,x(t) ,u(t) ,ip (t) ,s) - 
_ dt _ 

dht(t,x(t) ,u(t) ,ip(t) ,s) 
dt 


dh t (t,x{t),u(t), ip(t), s) 
dt 


= 0 , 

s=0 

(14) 
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with H the Hamiltonian ©• 

Having in mind condition m is equivalent to 


dH dH dH dH , N N d d 

3T t+ &' x + t sr- c, + w*-' s ' i(t) -' 4 (f) -s x + H s T = °- 


(15) 


where here, and to the end of the paper, all functions are evaluated at (t, x(t), u(t),ip(t)) 
whenever not indicated. Along a Pontryagin extremal (a;(-), u(-), ip{-)) equalities 
0 , 0 , ©, and m are in force, and m reduces to 

~ #) • X - m ■ ^ = 0 ^ J t (m -X-HT) = 0. 

We have just proved Noether’s theorem for optimal control problems. 

Theorem 1 (Noether’s Theorem). If the optimal control problem is invari¬ 
ant under CD. in the sense of Definition^ then 


xf{f) ■ X (t, x(t), u(t),ip(t)) - H (t, x(t),u(t), ip(t)) T (t, x(t),u(t), ip(t)) = c 

(16) 

(c a constant; t 6 [a, b\; T and X are given according to <11 HD : H is the Hamil¬ 
tonian m) is a conservation law, that is, is valid along all the minimizers 
(x(-),u(-)) of (P) which are Pontryagin extremals. 

All available versions of Noether’s theorem found in the literature are valid 
only for well-behaved optimal control problems (conservation laws are, by def¬ 
inition, valid for minimizers which are Pontryagin extremals). In the next sec¬ 
tion we provide the first optimal control version of Noether’s theorem valid in 
presence of bad behavior (valid also for minimizers which are not Pontryagin 
extremals). For that we need a new notion of conservation law. 


4 Weak Conservation Laws in Optimal Control 


In 1879 Paul duBois-Reymond proved an important basic result. From duBois- 
Reymond lemma we know that 


/ (if(t) ■ X - HT)6(t)dt = 0, Vfl(-) € Cg([o,6]), 

J a 

is a weak form of conservation law US. Follows the main result of the paper. 


Theorem 2. If the optimal control problem is invariant under O- in the 
sense of Definition^ then 


r b v 


i/j{t) ■X (t,x(t),u(t),ip(t)) 

- H (■t , x(t), u{t), ip(t)) T {t , x(t), u(t),if(t)) 


9(t)dt = 0 
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(9(-) is an arbitrary Wi^iQa, b]; M) function satisfying 9(a) = 9(b) = 0) holds 
along all the minimizers (x(-), u(-),ip(-)) G W \ : i x L\ x Wi t i of l[3j. 


Proof. Replacing the parameter s of the group GU by function s9(t ), the in¬ 
finitesimal generators are then given by 


-T- h t (t, x, u, if, s9(t)) 
as 

-y-h x (t,x,u,ip,s9(t)) 
as 

-Jf.h u (t,x,u,ip,s9(t)) 
jfh^ (t,x,u,if,s9(t)) 


= T(t,x,u,tl>)9(t ), 

5=0 

= X(t , x, u 7 if)9(t ), 

5=0 

= U(t , x, u, if)9(t ), 

5=0 

= ^(i, x 7 u, ip)9(t ), 

5=0 


with T, X , U, and as in o. and the necessary and sufficient condition of 
invariance m takes the form 


dH dH dH dH d.T dX\ , N 

aT r + & ' A + Tfa ' u + ' * - *' i(t) + H IF ^ (i) ’ ir) S(t) 

+ (HT-^(t)-X)i(t) = 0. ( 17 ) 

Condition ® with h\(t) = X9(t), h 2 (t) = U9(t), and / 13 (f) = T 9(t ), gives 


<•& r 


v dH rr dH T ■ / \ , dX 


9(f) 


-m)-x)m 


dt = 0. (18) 


Using CCD in mi permits to write 



-~y~T — H—\ 
dt dt) 


9{t)-W)-x)b(t) 


dt = O' 


while, on the other hand, using ra in m- one obtains 



dH 

~dt 


T+H 


dT 

dt 


9(f) + (HT) 9(f) 


dt = 0. 


The conclusion follows summing up m and (EH)) : 


(HT -ijj(t) ■ X)9(t)dt = 0. 


(19) 


( 20 ) 


□ 
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Invariance under an infinite continuous group of transformations, which 
rather than dependence on parameters depend upon arbitrary functions, is con¬ 
sidered by Noether in the original paper EJ. This is sometimes called “the 
second Noether theorem”. We refer the reader to m for an extension of the 
second Noether theorem to optimal control problems which are semi-invariant 
under symmetries depending upon k arbitrary functions of the independent vari¬ 
able and their derivatives. Theorem [5] is easily formulated under more general 
notions of invariance. 

Theorem |21 gives, from the invariance properties of the optimal control prob¬ 
lems, weak conservation laws along all the minimizers, including those mini- 
rnizers which does not satisfy the standard necessary optimality conditions like 
the Pontryagin Maximum Principle or the Euler-Lagrange differential equations. 
Such fact may be useful to identify more general classes of well- and bad-behaved 
problems in the calculus of variations and optimal control, e.g., to synthesize 
a broad class of invariant problems exhibiting the Lavrentiev phenomenon [2J. 
This possibility is under investigation and will be addressed elsewhere. 
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